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GOOFSPIEL— THE  GAME  OF  PURE  STRATEGY 


by 

Sheldon  M.  Rosr. 

1.  INTRODUCTION 

The  game  of  pure  strategy,  sometimes  called  Goof  spiel  or  Gops  (2}  and 

[3}),  is  played  by  two  players,  using  a  normal  deck  of  cards,  as  follows.  The  13 
clubs  are  first  taken  out  of  the  deck  and  of  the  remaining  39  cards  the  13  hearts 
are  given  to  Player  1,  the  13  diamonds  to  Player  II,  and  the  13  spades  are  placed 
face  down  in  the  center.  The  spades  are  shuffled  and  one  is  turned  face  up.  At 
this  point,  the  two  players  choose  one  of  their  cards  and  then  simultaneously 
discard  it.  The  one  who  discards  the  higher  card  (ace  being  low,  king  high)  wins 
from  the  other  an  amount  equal  to  the  value  of  the  upturned  spade  (ace  *  1  , 
king  =  13).  If  both  players  discard  the  same  card,  then  neither  wins.  The  three 
cards  are  then  thrown  away,  a  new  spade  upturned  and  the  game  continues.  After  13 
plays,  there  are  no  remaining  cards  and  the  game  ends. 

In  Section  2,  we  consider  this  game  under  the  assumption  that  Player  II  discard 
his  cards  in  a  completely  random  manner.  Given  this  information,  we  show  that  the 
best  thing  for  Player  I  to  do  is  to  always  match  the  upturned  spade,  i.e.,  if  the 
upturned  card  is  an  ace  then  I  should  play  his  ace,  etc.  The  expected  winnings  of 
Player  I  is  shown  to  equal  28  . 

In  Section  3,  we  show  how  Goofspiel  may  be  treated  as  a  stochastic  game.  This 
special  structure  is  then  utilized  to  determine  a  dynamic  programming  type 
recursion  algor itlira  for  solving  it. 

In  Section  A,  we  consider  the  game  of  Hidden  Card  Goofspiel.  In  this 
variation,  it  is  supposed  that  the  players  must  discard  before  the  middle  card  is 
turned  face  up.  The  randomizing  strategy  is  then  shown  to  he  optimal  for  both 
players. 
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2.  COOFPPIEL  AGAINST  A  RANDOM] ZIHC  OPPONENT 

Let  u«  first  generalize  our  game.  Suppose,  that  Player  I  has  N  cards  having 
values  vi*V2*  •  ••*  *  where  Vj  <  <_  . . .  —  VN  *  pla>'er  11  has  N  curds  having 

values  •••*  YN  *  where  <_  1.  •  ••  1.  Y^  ;  and  the  N  cards  in  the 

middle  have  values  Pi»P2*  •••»  »  where  P2  -  ‘  ‘  *  T*ie  Rame  *8 

played  as  before:  One*  of  the  center  cards  is  turned  face  up.  The  players  then 

simultaneously  discard  and  whoever' s  card  has  the  higher  value  wins  from  the  other 

an  amount  equal  to  the  value  of  the  middle  card.  These  three  cards  arc:  then  thrown 
away  and  the  play  continues  until  there  are  no  cards  left. 

Theorem  1: 

If  Player  II  discards  in  a  completely  random  manner,  then  the  strategy 
maximizing  Player  I's  expected  winning  is  the  one  which  discards  the  card  having 
value  whenever  the  upturned  middle  card  has  value  ,  i  ■  1,2,  ...,N. 


Proof: 


The  proof  is  by  induction  on  N  .  The  theorem  is  trivially  true  for  N  =  1  , 
so  assume  it  for  N  -  1  .  Suppose  now  that  for  the  N-card  problem  the  initial 

upturned  card  has  value  P^  and  consider  any  strategy  which  calls  for  Player  I  to 

play  where  i  <  j  .  After  this  first  discard,  I  has  cards 

1,  . ..,  i-l,i+l . j,  ...,  N  ,  while  the  center  has  cards 

1,  ....  i . J-l.J+1,  ....  N  .  Hence,  from  the  induction  hypothesis,  it  follows 

that  if  the  initial  upturned  card  has  value  P^  then,  among  those  strategies  which 

call  for  I  to  play  ,  the  best  is  the  one  which  plays 


(1) 


rk  , 

O"  I'j 

°n  Pk  , 

on  PR  , 


k  =  1 ,  ....  i-1 


k  =  i,  ....  j-1 
k  =  j+1 ,  . . . ,  N  . 


3 


Compare  thin,  however,  with  the  strategy  which  Is  the  same  as  (1)  with  the 
exception  that  it  uses 


(2) 


vi+i  on 


Vi  on  Pi  * 


That  Is,  strategies  (1)  and  (2)  are  identical  except  that  (1)  uses 


V 


i 


V 


i+1 


on  Pj 
on 


and  the  second  uses  (2).  The  expected  payoff  to  Player  I  for  these  two  plays  Is, 
under  strategy  (1) 


1/N  Pj  [  (Number  k  :  Y^  <  -  (Number  k  .*  >  V^] 

+  1/N  P  I  (Number  k  :  Yk  <  Vi+1)  -  (Number  k  :  Yfc  >  V1+1)] 


while  under  strategy  (2)  it  is 

1/N  p  [  (Number  k  :  Yk  <  vi)  -  (Number  k  :  Yk  >  Vi>] 

+  1/N  Pj  [  (Number  k  :  Y^  <  Vi+^)  -  (Number  k  :  Yk  >  V1+1»  . 

Hence,  strategy  (2)  is  at  least  as  good  as  strategy  (1).  Therefore,  for  any 
i  <  j  ,  whenever  the  initial  upturned  card  is  Pj  ,  there  is  a  strategy  which  plays 
V1+i  ,  that  is,  at  least  as  good  as  any  which  plays  .  By  repeating  this 
argument,  it  follows  that  there  is  a  strategy  which  initially  plays  Vj  ,  that  is, 
at  least  as  good  as  any  playing  .  Similar  results  may  be  shown  for  i  >  j  and 
hence  by  t lie  induction  hypothesis  the  strategy  which  always  matches  the  upturned 
cord  is  opt  iraal. 


Q.E.D. 


Corollary  1: 


If  Player  II  plays  randomly,  then 

(1)  for  any  value  x  ,  the  probability  that  Player  I's  winnings  exceeds 
x  is  maximized  by  the  matching  strategy,  and 

(ii)  the  expected  winnings  of  Player  I  is 

N 

1/N  l  P  [(Number  j  :  Y  <  V  )  -  (Number  j  :  Y  >  V  )]  . 
i-1  1  J  1  J  1 

(iii)  If  ■  Yj^  ■  i  ,  then  (ii)  equals 

(N  -  1)  (N  +  1) 

6 

Proof: 

Part  (i)  is  proved  by  showing  that  Player  I’s  winnings  is  stochastically 
larger  under  strategy  (1)  than  it  is  under  strategy  (2).  This  is  shown  by 
considering  all  possible  outcomes  of  the  two  plays  P^  and  P  . 

Parts  (ii)  and  (iii)  are  obvious. 
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3.  GOOFS  PI  EL  AS  A  SlIPER-GAMM 


We  first  note  that  the  number  of  pure  strategies  for  each  player  is 


N-l 

WN  R  .  k(k+l) 
N  n  k 


To  see  why  (3)  is  true,  reason  as  follows.  For  each  initial  upturned  middle  card, 

N 

Player  I  has  a  choice  of  N  cards;  hence,  the  first  term  N  .  Now,  conditional 

on  the  first  upturned  card  and  the  first  card  played  by  I,  the  choice  of  1  on  the 

second  play  is  determined  by  the  second  upturned  card  and  the  first  card  played  by 

(N-l)N 

Player  II;  hence,  the  second  term  (N-l)  .  The  reasoning  progresses 

similarly. 

From  (3),  it  is  clear  that  it  is  not  possible  to  write  down  all  the  pure 

1" 

strategies  and  calculate  the  payoff  matrix.  Rather,  we  shall  attempt  to  treat 
N-card  Goofspiel  as  a  supergame  consisting  of  N  subgames,  and  develop  a  dynamic 
programming  type  recursion  relation.  Towards  this  end,  let 

f (Vx,  ...,  vn»y1 . YN,P1*  •••»  PN,Pk^  be  the  value  of  the  game  Lo  1  if  1 

initially  has  values  . ,  II  initially  has  values  Y^,  ...,  Y^  ,  the 

middle  initially  has  values  P^,  ...,  ,  and  the  initial  upturned  card  is  P^  . 


£<Vlt  •••*  Y^,Y^,  ...,  Y^,P^,  •••*  m  value  of  the  N  x  N  game 

with  payoff  matrix  [X^] 


where 


For  N  =  4  ,  Equation  (3)  tells  us  that  there  are  more  than  8.4  billion  pure 
strategies. 
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N 


+  N  -  1  f(Vl  “  Vi-lVi+l  *•  VN,Y1  **  Yj-lYj+l  *'  YN,P1  “  Pk-lPk+l  **  PN#,V 


(5) 


i1 

o 

(-!  VV 


Equation  (4)  is  true  because  after  the  initial  play  the  situation  is  the  same  as 
if  the  players  had  started  with  N  -  1  cards.  Thus  the  N  card  problem  may  be 
solved  by  first  solving  all  N  -  1  card  problems,  which  may  be  solved  in  terms  of 
all  N  -  2  card  problems,  etc.  Hence,  solving  recursively  (or  backwards),  we 
would  need  to  solve 

^(j)  J  by  1  games  for  j  «  1,2,  ...,  N  . 

For  instance,  when  N  ■  4  ,  rather  than  having  to  solve  one  8.4  billion  by 

8.4  billion  game,  we  would  need  to  solve  4  £our-by-four  games,  192  three-by-three 

games,  and  432  two-by-two  games. 

The  necessary  computation  simplifies  considerably  if  we  suppose  that  the 
middle  cards  are  turned  over  in  some  fixed  order.  In  this  case,  we  would  need  to 
recursively  solve 

j  by  j  games  for  j  ■  1,2,  ...,  N  . 


In  this  case,  the  number  of  pure  strategies  available  for  each  player  is 
N-l 

N  n  kP 
k=l 


k+1 


A 
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4.  ninnn;  ta r»  cih  htim  ta 

The  game  of  I!  ill  Jen  Card  i.oof  hj»  1  «*1  in  played  ah  before  with  the  exception  ttuil 
the  players  are  required  to  dl Heard  their  cards  before  the  point  value  of  the  play 
la  revealed  to  tin...  That  to,  the  middle  rarda  ore  shuffled  and  one  la  placed  face 
down  and  then  the  play  or  a  aimul  tane.uiHly  discard  a  card.  The  three  cards  arc  then 
turned  face  up  and  the  game  continues. 

Theorem  2: 


For  Hidden  Card  Coofapicl  randomizing  it  optimal  for  each  player  and  the 
value  of  the  game  to  Player  1  la 


(6) 


1/N' 


N 

l 

k-1 


i.j 


N 

V«i 


where  A  is  given  by  (5). 

Proof : 

Uc  prove  this  by  showing  that  if  I  randomizes  then  his  expected  return  is 
given  by  (5)  irrcgardless  of  II' s  strategy.  This  is  proven  by  Induction  on  N  . 
It  is  ohvious  for  N  "  1  ,  hence  assume  it  for  N  -  1  .  Suppose  now  that  for  the 
N-card  problem  II  initially  plays  Y^  .  Then,  by  the  induction  hypothesis,  it 
follows  that  1'k  expected  payoff  given  that  he  randomizes  is  exactly 


(7) 


1/N 


N 

l 

i,k«l 


Vij 


1 


(N  -  1)  £y«k 


i  pt  n 


4*1 

MJ 


Ik 


and  the  induction  will  be  completed  if  we  can  show  that  (7)  equals  (6).  This, 
however,  follows  by  first  noting  that  (6)  is  Just  the  expected  payoff  to  I  given 
that  1  and  1]  both  randomize.  However,  by  writing  the  payoff  to  1  as  the  payoff  to 
I  on  the  play  for  which  II  uses  Y^  plus  the  payoff  to  I  on  the  remaining  plays 
of  the  pome,  it  follows  by  conditioning  on  the  middle  value  and  I'a  card  on  the 


play  that  II  uaea  that  (7)  alao  represents  the  expected  payoff  to  I  given 
that  X  and  11  both  randomise.  Hence,  (7)  equals  (ft)  and  the  induction  is  complot 
This,  however,  implies  that  the  randoulsad  strategy  guarantees  1  the  value  (6) 
lrregardless  of  Il's  strategy.  Also,  by  reversing  the  roles  of  1  ev>J  I],  it 
follows  that  if  II  randomises  then  he  can  lose  no  more  than  (6)  and  the  result 
follows. 

iSSftrks 

Theorem  2  is  somewhat  similar  to  a  result  proven  by  Gale  [1]. 
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